-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[wptrunner] Support testdriver.js in {ref,print-ref,crash}tests #48486
[wptrunner] Support testdriver.js in {ref,print-ref,crash}tests #48486
Conversation
41b2fb1
to
c4a6d69
Compare
7b80717
to
25d7265
Compare
a0230ef
to
0efaa69
Compare
PTAL @WeizhongX @jgraham. Chrome and Safari pass the new |
Relax the `TESTDRIVER-IN-UNSUPPORTED-TYPE` rule now that #48486 has landed. `wpt lint` still bans `testdriver.js` in manual tests, since there's no external WebDriver program to drive testdriver.
...so is it now ok to move some tests using this capability over to the repo? |
From pure WPT PRs, yes. From |
@mfreed7 |
Nice! Thanks for getting this landed. {I'll give it a try myself, here: https://crrev.com/c/6077774 } |
See conversations at: web-platform-tests/rfcs#211 #13183 As of today, this can land: #48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242
As of #48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02
As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <[email protected]> Commit-Queue: Mike Wasserman <[email protected]> Auto-Submit: Jonathan Lee <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396271}
As of #48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <[email protected]> Commit-Queue: Mike Wasserman <[email protected]> Auto-Submit: Jonathan Lee <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396271}
See conversations at: web-platform-tests/rfcs#211 #13183 As of today, this can land: #48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <[email protected]> Auto-Submit: Mason Freed <[email protected]> Commit-Queue: Mason Freed <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396273}
See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <[email protected]> Auto-Submit: Mason Freed <[email protected]> Commit-Queue: Mason Freed <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396273}
As of #48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <[email protected]> Commit-Queue: Mike Wasserman <[email protected]> Auto-Submit: Jonathan Lee <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396271}
See conversations at: web-platform-tests/rfcs#211 #13183 As of today, this can land: #48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <[email protected]> Auto-Submit: Mason Freed <[email protected]> Commit-Queue: Mason Freed <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396273}
…sts that use testdriver, a=testonly Automatic update from web-platform-tests [wpt][fullscreen] Upstream {ref,crash}tests that use testdriver As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <[email protected]> Commit-Queue: Mike Wasserman <[email protected]> Auto-Submit: Jonathan Lee <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396271} -- wpt-commits: 70e5fd98c0eed8d024c7743fb476386a36c8b8d0 wpt-pr: 49690
… tests out of wpt_internal, a=testonly Automatic update from web-platform-tests Move all customizable-<select> reference tests out of wpt_internal See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <[email protected]> Auto-Submit: Mason Freed <[email protected]> Commit-Queue: Mason Freed <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396273} -- wpt-commits: 2134b52a0ed40aeb768cd2c2856db9b4724527a7 wpt-pr: 49688
…sts that use testdriver, a=testonly Automatic update from web-platform-tests [wpt][fullscreen] Upstream {ref,crash}tests that use testdriver As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <[email protected]> Commit-Queue: Mike Wasserman <[email protected]> Auto-Submit: Jonathan Lee <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396271} -- wpt-commits: 70e5fd98c0eed8d024c7743fb476386a36c8b8d0 wpt-pr: 49690
… tests out of wpt_internal, a=testonly Automatic update from web-platform-tests Move all customizable-<select> reference tests out of wpt_internal See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <[email protected]> Auto-Submit: Mason Freed <[email protected]> Commit-Queue: Mason Freed <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396273} -- wpt-commits: 2134b52a0ed40aeb768cd2c2856db9b4724527a7 wpt-pr: 49688
…sts that use testdriver, a=testonly Automatic update from web-platform-tests [wpt][fullscreen] Upstream {ref,crash}tests that use testdriver As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <mswchromium.org> Commit-Queue: Mike Wasserman <mswchromium.org> Auto-Submit: Jonathan Lee <jonathanjleegoogle.com> Cr-Commit-Position: refs/heads/main{#1396271} -- wpt-commits: 70e5fd98c0eed8d024c7743fb476386a36c8b8d0 wpt-pr: 49690 UltraBlame original commit: d40b2c8ff387c21e9289b92afdc86dcad1e4c426
… tests out of wpt_internal, a=testonly Automatic update from web-platform-tests Move all customizable-<select> reference tests out of wpt_internal See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <jarharchromium.org> Auto-Submit: Mason Freed <masonfchromium.org> Commit-Queue: Mason Freed <masonfchromium.org> Cr-Commit-Position: refs/heads/main{#1396273} -- wpt-commits: 2134b52a0ed40aeb768cd2c2856db9b4724527a7 wpt-pr: 49688 UltraBlame original commit: 31380657f025c9e677795d2107c4264f45cfc0a6
…sts that use testdriver, a=testonly Automatic update from web-platform-tests [wpt][fullscreen] Upstream {ref,crash}tests that use testdriver As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <mswchromium.org> Commit-Queue: Mike Wasserman <mswchromium.org> Auto-Submit: Jonathan Lee <jonathanjleegoogle.com> Cr-Commit-Position: refs/heads/main{#1396271} -- wpt-commits: 70e5fd98c0eed8d024c7743fb476386a36c8b8d0 wpt-pr: 49690 UltraBlame original commit: d40b2c8ff387c21e9289b92afdc86dcad1e4c426
… tests out of wpt_internal, a=testonly Automatic update from web-platform-tests Move all customizable-<select> reference tests out of wpt_internal See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <jarharchromium.org> Auto-Submit: Mason Freed <masonfchromium.org> Commit-Queue: Mason Freed <masonfchromium.org> Cr-Commit-Position: refs/heads/main{#1396273} -- wpt-commits: 2134b52a0ed40aeb768cd2c2856db9b4724527a7 wpt-pr: 49688 UltraBlame original commit: 31380657f025c9e677795d2107c4264f45cfc0a6
…sts that use testdriver, a=testonly Automatic update from web-platform-tests [wpt][fullscreen] Upstream {ref,crash}tests that use testdriver As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <mswchromium.org> Commit-Queue: Mike Wasserman <mswchromium.org> Auto-Submit: Jonathan Lee <jonathanjleegoogle.com> Cr-Commit-Position: refs/heads/main{#1396271} -- wpt-commits: 70e5fd98c0eed8d024c7743fb476386a36c8b8d0 wpt-pr: 49690 UltraBlame original commit: d40b2c8ff387c21e9289b92afdc86dcad1e4c426
… tests out of wpt_internal, a=testonly Automatic update from web-platform-tests Move all customizable-<select> reference tests out of wpt_internal See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <jarharchromium.org> Auto-Submit: Mason Freed <masonfchromium.org> Commit-Queue: Mason Freed <masonfchromium.org> Cr-Commit-Position: refs/heads/main{#1396273} -- wpt-commits: 2134b52a0ed40aeb768cd2c2856db9b4724527a7 wpt-pr: 49688 UltraBlame original commit: 31380657f025c9e677795d2107c4264f45cfc0a6
…sts that use testdriver, a=testonly Automatic update from web-platform-tests [wpt][fullscreen] Upstream {ref,crash}tests that use testdriver As of web-platform-tests/wpt#48486, the WebDriver-based testdriver infrastructure now supports {ref,crash}tests. Revert most of https://crrev.com/c/5972758 to move the tests back. In Chromium CQ, moving the tests out of `wpt_internal/` also has the effect of running the tests with `headless_shell` + `chromedriver`, which passes these tests. Bug: None Change-Id: I396053ab5a7ab2a27558fa1de71af614107a8f02 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Reviewed-by: Mike Wasserman <[email protected]> Commit-Queue: Mike Wasserman <[email protected]> Auto-Submit: Jonathan Lee <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396271} -- wpt-commits: 70e5fd98c0eed8d024c7743fb476386a36c8b8d0 wpt-pr: 49690
… tests out of wpt_internal, a=testonly Automatic update from web-platform-tests Move all customizable-<select> reference tests out of wpt_internal See conversations at: web-platform-tests/rfcs#211 web-platform-tests/wpt#13183 As of today, this can land: web-platform-tests/wpt#48486 See, e.g.: https://chromium-review.googlesource.com/c/chromium/src/+/6088404 Change-Id: I43ffb77f93f4fa28e7aaa65beea8780f52f87242 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6077774 Reviewed-by: Joey Arhar <[email protected]> Auto-Submit: Mason Freed <[email protected]> Commit-Queue: Mason Freed <[email protected]> Cr-Commit-Position: refs/heads/main@{#1396273} -- wpt-commits: 2134b52a0ed40aeb768cd2c2856db9b4724527a7 wpt-pr: 49688
Implements the
wpt {manifest,run}
changes proposed in web-platform-tests/rfcs#211.